Computationally efficient confidence intervals for cross-validated area under the ROC curve estimates
نویسندگان
چکیده
منابع مشابه
Confidence Intervals for the Area Under the ROC Curve
In many applications, good ranking is a highly desirable performance for a classifier. The criterion commonly used to measure the ranking quality of a classification algorithm is the area under the ROC curve (AUC). To report it properly, it is crucial to determine an interval of confidence for its value. This paper provides confidence intervals for the AUC based on a statistical and combinatori...
متن کاملPermutation Tests and Confidence Intervals for the Area under the Roc-curve
We investigate rank-based studentized permutation methods for the nonparametric Behrens-Fisher problem, i.e. inference methods for the area under the ROC-curve (AUC). We hereby prove that the studentized permutation distribution of the Brunner-Munzel rank statistic is asymptotically standard normal, even under the alternative. This does not only imply consistency of the corresponding permutatio...
متن کاملArea Under the Precision-Recall Curve: Point Estimates and Confidence Intervals
The area under the precision-recall curve (AUCPR) is a single number summary of the information in the precision-recall (PR) curve. Similar to the receiver operating characteristic curve, the PR curve has its own unique properties that make estimating its enclosed area challenging. Besides a point estimate of the area, an interval estimate is often required to express magnitude and uncertainty....
متن کاملComparison of non-parametric confidence intervals for the area under the ROC curve of a continuous-scale diagnostic test.
The accuracy of a diagnostic test with continuous-scale results is of high importance in clinical medicine. It is often summarised by the area under the ROC curve (AUC). In this article, we discuss and compare nine non-parametric confidence intervals of the AUC for a continuous-scale diagnostic test. Simulation studies are conducted to evaluate the relative performance of the confidence interva...
متن کاملArea specific confidence intervals for a small area mean under the Fay-Herriot model
‎Small area estimates have received much attention from both private and public sectors due to the growing demand for effective planning of health services‎, ‎apportioning of government funds and policy and decision making‎. ‎Surveys are generally designed to give representative estimates at national or district level‎, ‎but estimates of variables of interest are oft...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronic Journal of Statistics
سال: 2015
ISSN: 1935-7524
DOI: 10.1214/15-ejs1035